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PREFACE 


This  paper  was  written  to  serve  as  an  educational  aid 
for  those  persons  interested  in  but  generally  unfamiliar  with 
adaptive  space  processing. 

No  attempt  has  been  made  to  present  any  new  material. 
Instead,  the  author  has  attempted  to  survey  the  field  of  adaptive 
space  processing  and  to  discuss  those  concepts  and  techniques 
deemed  to  be  important. 

A consolidated  bibliography  is  provided.  The  biblio- 
graphy and  the  text  are  equally  important,  since  it  is" in  the-^^ 
items  of  the  bibliography  that  the  serious  reader  will  find 
rigorous  mathematical  developments  of  the  concepts  and  techniques 
invo lved . 
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1.  INTRODUCTION 

It  has  become  increasingly  apparent  over  the  past 
several  years  that  serious  consideration  should  be  given  to  the 
use  of  adaptive  space  processing  for  the  detection,  classification, 
and  localization  of  enemy  submarines.  A number  of  papers  have 
been  written  which  deal  extensively  with  the  theoretical  aspects 
of  both  adaptive  and  non-adaptive  space  processing.  The  biblio- 
graphy lists  several  such  papers. 

Although  many  papers  are  available  which  deal  rigorously 
with  the  theory,  there  is  a lack  of  published  data  relative  to 
the  practicality  of  implementation  of  adaptive  space  processing. 
Little  has  been  said,  for  example,  regarding  the  computational 
tradeoffs  available  for  different  types  of  systems  operating  in 
different  types  of  signal  and  noise  fields. 

The  objective  in  applying  adaptive  space  processing 
is  to  design  a system  which  will  change  its  operating  character- 
istics as  a function  of  the  spatial  organization  of  signal  and 
noise  so  as  to  provide  the  best  processing  possible  to  combat  the 
then  existing  spatially  organized  noise  field. 

For  example,  many  sonar  spatial  processing  systems 
(or  beamformers)  are  designed  under  two  assumptions,  neither 
of  which  may  be  valid  in  many  cases.  The  first  assumption  which 
is  commonly  made  is  that  the  noise  field  has  a spatially  isotropic 
distribution.  That  is,  equal  noise  energy  propagates  from  all 
directions  in  three  dimensional  space.  This  assumption  is 
certainly  not  valid  for  a passive  sonar  system  mounted  in  a 
submarine  providing  protection  for  a convoy.  For  this  case,  the 
primary  interfering  noise  may  well  be  generated  by  the  ships  in 
the  convoy  and  as  such,  would  propagate  generally  from  the  direc- 
tion of  the  convoy.  An  adaptive  spatial  processing  system  would 
adjust  itself  so  as  to  suppress  the  high  intensity  convoy  noise 
and  accept  lower  intensity  noise  from  some  other  direction. 
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A second  assumption  which  is  often  made  is  that  the 
interfering  noise  is  describable  as  plane  waves  and  hence  can  be 
analyzed  through  the  use  of  beam  patterns.  It  is  unlikely  that 
ship  self  noise  which  couples  into  the  transducer  through  the 
structure  appears  to  propagate  as  plane  waves.  Nonetheless, 
an  adaptive  processor  would  adjust  itself  so  as  to  combat  this 
type  of  noise. 

In  general  the  potential  effectiveness  of  adaptive 
space  processing  depends  on  whether  or  not  there  is  an  exploitable 
difference  in  the  way  signals  and  noise  are  organized  in  space. 

Work  which  has  made  direct  contributions  to  the 
technology  of  sophisticated  spatial  processing  is  listed  below. 
Undoubtedly,  significant  contributions  have  been  made  by  other 
persons,  whose  work  has  not  come  to  the  author's  attention. 

Dr.  Finn  Bryn,  while  on  a Royal  Norwegian  Council  of 
Scientific  and  Industrial  Research  fellowship,  at  the  Marine 
Physical  Laboratory  of  the  Scripps  Institution  of  Oceanography, 
developed  a theory  of  optimum  signal  processing  for  three- 
dimensional  arrays  operating  on  Gaussian  signals  and  noise. 
Portions  of  his  work  were  submitted  to  "The  Journal  of  the 
Acoustical  Society  of  America"  in  July  1961,  and  published  in 
March  1962  (12). 

During  the  same  time  period,  Dr.  Milo  Backus,  Dr.  L. 
Strickland,  Mr.  John  Burg  and  associates,  all  of  Texas  Instruments 
Incorporated,  working  under  contract  to  the  U.  S.  Air  Force, 
developed  a theory  for  spatial  processing  of  seismometer  arrays 


based  on  the  Wiener  least-mean-square-error  criterion.  The  final 
report  on  this  work  was  submitted  to  the  Air  Force  in  midyear 
1961.  The  work  was  later  published  in  "Geophysics"  in  October 


This  work  was  generally  concerned  with  an  optimum 
frequency-domain  solution  to  the  array  processing  problem  as 
was  the  work  done  by  Bryn.  By  midyear  1963,  Burg  had  developed 
and  utilized  an  algorithm  for  the  solution  of  the  Wiener  optimum 
array  processing  problem  completely  in  the  time  domain.  To  the 
knowledge  of  the  author,  Burg  has  never  published  the  results 
of  this  work  other  than  in  reports  submitted  to  the  Air  Force. 
However,  a description  of  the  work  is  contained  in  reference  (104). 

During  the  same  general  time  period.  Dr.  Ralph  A.  Wiggins 
of  the  Department  of  Geology  and  Geophysics,  Massachusetts 
^ Institute  of  Technology,  and  Dr.  Enders  A.  Robinson,  Seismo logical 

Institute,  Uppsala  University,  Uppsala,  Sweden,  became  interested 
in  the  same  problem  and  published  their  results  (123)  in  the  Journal 
of  Geophysical  Research  in  April,  1965. 

Dr.  H.  Mermoz  (7)  of  the  Institute  Polytechnique , 
Grenoble,  France,  published  two  papers  in  1964  which  were  concerned 
with  the  optimum  utilization  of  an  array  for  separation  of  a 
signal  of  known  waveform  from  noise. 

All  of  the  contributions  mentioned  thus  far  were  con- 
cerned with  matrix- inversion  techniques  for  the  optimum  solution 
to  the  array  processing  problem.  In  May  1965,  Capt.  S.  W.  W.  Shor 
of  the  Anti-Submarine  Warfare  Systems  Project  Office,  U.  S. 
Department  of  the  Navy,  submitted  a paper  (94)  to  The  Journal  of 
the  Acoustical  Society  of  America  which  was  concerned  with  an 
iterative  solution  to  the  problem  of  optimum  utilization  of  an 
array.  The  paper  was  subsequently  published  in  January  1966. 

Professor  Bernard  Widrow  at  Stanford  University  (102) 
became  interested  in  the  problem  in  1965  and  in  late  1965  he  and 
an  associate,  Mr.  Burwell  Goode  of  NEL,  began  work  on  a research 
program  concerned  with  the  utilization  of  machine  learning 
techniques  for  the  optimum  solution  of  adaptive  space  processing 
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problems.  As  yet  their  work  is  unpublished.  It  is  the  opinion 
of  the  author  that  Professor  Widrow  and  Mr.  Goode  have  made  a 
significant  contribution  to  the  technology  of  truly  adaptive 
spatial  processing. 

The  bulk  of  the  work  which  has  been  done  to  date  has 
been  based  on  three  different  optimization  criteria: 

(1)  Maximization  of  signal- to-noise  ratio. 

(2)  Maximization  of  likelihood  ratio  for  decision 
purposes . 

(3)  Extraction  of  best  estimate  of  signal  waveform.  i 

The  first  criterion  is  exemplified  by  Shor  (94),  who 
provides  an  iterative  technique  for  maximizing  the  signal- to-noise 
ratio  at  a single  frequency  in  the  output  of  an  array  processor. 

Kis  work  is  based  on  earlier  work  by  Dr.  H.  Mermoz  (7). 

Widrow  (102)  and  Goode  have  extended  and  simplified 
the  iterative  techniques  so  that  they  are  applicable  to  either 
narrow-band  or  wide-band  array  processing.  Their  criterion  is 
to  hold  the  output  signal  power  constant  while  minimizing  the 
output  noise  power. 

The  second  criterion  is  exemplified  by  Bryn  (12)  who 
provides  a method  for  obtaining  an  output  from  the  array  which  can 
be  used  for  statistical  decision  purposes.  Burg  (17)  provides  a 
method  of  optimizing  on  the  basis  of  the  third  criterion. 

Since  the  techniques  presented  in  these  five  references 
are  representative  of  the  three  basic  criteria,  the  bulk  of  the 
present  discussion  will  be  based  on  the  five  references  given 
above . 

This  paper  presents  a discussion  of  some  of  the  important 
characteristics  of  the  different  techniques  including  computational 
requi remen ts . 
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The  reader  is  referred  to  the  bibliography  for 
detailed  and  rigorous  treatments  of  the  mathematical  and  statistical 
concepts  involved. 
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2.  SUMMARY  AND  CONCLUSIONS 

The  computational  requirements  for  the  Wiener,  Bryn, 

Shor,  and  Widrow  adaptive  space  processing  techniques  were 
evaluated  relative  to  three  different  multiple  beam  array  pro- 
cessing problems.  It  was  concluded,  for  the  three  cases  con- 
sidered, that  the  Bryn  matrix  inversion  technique  is  computationally 
more  attractive  than  either  the  Wiener  frequency  domain  technique 
or  the  Shor  iterative  technique. 

For  multiple  beam  problems,  this  should  in  general  be 
true  since  the  Bryn  technique  requires  only  one  noise  matrix 
inversion  no  matter  how  many  beams  are  to  be  formed  simultaneously. 
The  Wiener  technique  requires  a separate  matrix  inversion  for 
each  adaptive  beam  and  the  Shor  technique  requires  a new  iteration 
for  each  adaptive  beam. 

It  was  further  concluded  that  the  Widrow  technique  was 
more  attractive  than  the  Bryn  technique  in  terms  of  storage 
requirements.  No  conclusions  could  be  drawn  relative  to  the 
computational  difficulty  of  the  Widrow  technique  since  the  con- 
vergence rates  are  presently  unavailable. 
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3.  CONCEPTS  AND  OPTIMIZATION  CRITERIA 

The  following  paragraphs  present  a discussion  of  con- 
cepts and  optimization  criteria  which  exemplify  the  three  criteria 
presented  in  the  introduction. 

3.1  WIENER  CRITERION 

The  Texas  Instruments  approach  on  adaptive  beamforming, 
as  outlined  in  Burg's  paper  and  in  the  NEL  report(104),  makes  use 
of  the  Wiener  least-mean- square  error  criterion.  The  technique 
can  be  applied  in  either  the  time  domain  or  the  frequency  domain. 

In  either  case,  the  design  is  such  that  an  attempt  is  made  to 
extract  the  signal  from  the  noise  in  an  undistorted  fashion. 

That  is,  the  processor  operates  on  a set  of  transducer 
outputs,  each  containing  signal-plus-noise,  and  attempts  to  pro- 
vide an  output  consisting  of  a noise  free  reproduction  of  the 
signal  as  it  appears  on  a reference  transducer.  It  is  generally 
not  possible  to  produce  a noise  free  output.  In  that  event,  the 
output  noise  level  is  reduced  as  much  as  possible  based  on  any 
differences  that  exist  between  the  organization  of  signals  and 
noise  in  space.  The  output  signal  is  a near  reproduction  of  the 
reference  signal  added  to  the  output  noise.  With  this  technique, 
signal  distortion,  as  well  as  output  noise,  contributes  to  the 
error  term.  Hence,  signal  distortion  is  minimized. 

The  differences  in  the  spatial  organization  need  not 
necessarily  be  simple  differences  in  the  direction  of  propagation. 
For  example,  if  the  ship  self  noise  couples  into  the  different 
transducers  at  different  levels  but  in  such  a manner  that  the 
noise  output  from  one  transducer  is  strongly  correlated  with  the 
noise  output  from  another  transducer,  then  this  represents  a type 
of  space  organized  noise  which  can  be  handled  with  any  of  the 
techniques  under  discussion,  but  which  is  not  generally  describable 
by  use  of  beam  patterns. 
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EOne  important  characteristic  of  the  Wiener  optimization 

criterion  is  that  knowledge  of  the  signal  waveform  is  not  required. 
Shor  indicates  that  his  technique  requires  knowledge  of  the  exact 
waveform  of  the  expected  signal.  It  is  not  clear  why,  unless  he 
requires  this  simply  to  satisfy  the  requirements  of  the  matched 
filter  which  he  cascades  with  the  output  of  the  adaptive  space 
processor.  In  general,  it  is  the  relative  phase  characteristic 
between  hydrophones  which  is  important  in  space  processing  and 
not  the  absolute  phase  characteristics. 

The  information  required  for  implementation  of  the 
Wiener  technique  is  the  cross-correlation  sets  describing  signal 
and  noise.  The  cross-correlation  set  describing  signal  can 
probably  be  synthetically  generated  once  the  characteristics  of 
the  array  elements  are  well  in  hand.  The  cross-correlation  set 
describing  noise,  however,  must  be  repeatedly  measured  for  an 
adaptive  system.  It  is  important  to  note  that  if  it  is  desired 
to  form  a set  of  adaptive  beams  simultaneously,  using  the  same 
set  of  transducers,  then  only  one  set  of  noise  correlation  functions 
is  required  to  design  the  full  set  of  beam  programs.  It  is 
necessary,  however,  to  either  measure  or  otherwise  provide  a 
signal  correlation  set  for  each  adaptive  beam  design. 

3.2  SHOR  CRITERION 

The  Shor  criterion  is  very  straightforward.  That  is. 


design  a spatial  processing  system  which  will  maximize  the  signal- 
to-noise  ratio  in  the  output.  He  shows  that  the  output  signal- 
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where  S^SQ  is  the  cross  correlation  between  the  output  signal 
and  the  input  signal  on  channel  i, 

N .N  is  the  cross-correlation  between  the  output  noise 
i o 

and  the  input  noise  on  channel  i,  and 

S SQ  and  NqNo  are  output  signal  power  and  noise  power 
respectively. 

For  purposes  of  comparison,  the  Wiener  criterion  is 
satisfied  whenever 


SiSo  + NiNo  = SiSr  for  a11  1 > 


where  is  the  signal  cross-correlation  between  each  input 

channel  and  a reference  channel. 

The  Bryn  criterion,  to  be  discussed  later,  is  satisfied 

whenever 


N.N 
i o 


= S.S 
i r 


It  is  interesting  to  note  that  at  least  for  unidirec- 
tional signal  models,  a set  of  optimum  answers  obtained  with 
either  the  Wiener  or  Bryn  techniques  will  satisfy  the  Shor 
criterion.  At  least,  the  author  has  been  unable  to  show  that 
this  is  not  true  and  can  demonstrate  that  it  is  true  for  numerous 
simple  problems. 

There  is  one  case,  that  of  perfectly  coherent  noise, 
for  which  the  Shor  technique  will  fail  to  provide  a set  of  optimum 
answers.  In  that  event,  the  normalized  noise  correlation  will 
approach  an  indeterminate  value.  However,  since  this  case  is 
extremely  unlikely  to  occur  in  nature,  this  does  not  present  a 
serious  obstacle. 


9 


TRACOR,  INC.  6boo  tracoh  lane.  Austin,  Texas  78721 

3.3  BRYN  CRITERION 

The  Bryn  criterion  does  not  lend  itself  to  nearly  so 
simple  a physical  interpretation  as  do  the  Shor  and  Wiener 
criteria.  Bryn  bases  his  case  on  the  presentation  of  a likelihood 
ratio  which  can  be  compared  with  a known  threshold  for  decision 
purposes.  The  argument  depends  heavily  upon  Gaussian  distributions 
in  order  that  the  final  result  will  be  interpretable  as  a decision 
making  function.  In  spite  of  the  Gaussian  assumptions,  Bryn 
develops  a spatial  processor  which  appears  to  provide  the  same 
output  signal- to-noise  ratio  as  the  Wiener  technique. 

Implementation  of  the  technique  involves  the  inverting 
of  a matrix,  the  same  size  as  with  the  Wiener  technique.  The 
matrix,  however,  does  not  contain  the  same  information.  The  Bryn 
technique  requires  the  full  cross-correlation  matrix  for  noise, 
and  one  column  of  the  cross-correlation  matrix  for  signal.  This 
is  less  information  than  is  required  for  the  Wiener  technique. 

The  Bryn  technique,  like  the  Shor  technique,  will 
fail  to  provide  a set  of  optimum  answers  whenever  the  noise  is 
totally  coherent.  For  this  case,  the  Bryn  matrix  will  be  singular. 

3.4  WIDROW- GOODE  CRITERION 

Widrow  and  Goode  have  been  engaged  in  research  related 
to  the  use  of  iterative  learning  techniques  for  adaptive  processing 
of  hydrophone  arrays. 

The  criterion  which  they  have  used  can  be  considered 
as  a signal- to-noise  power  ratio  maximization  criterion  (L02,  pg  5). 
The  system  operates  under  two  separate  (in  time)  adaptation  modes. 
During  the  first  mode,  the  system  is  "taught"  to  faithfully 
reproduce  signals  according  to  a specific  definition  of  signal. 
During  the  second  mode,  the  system  is  taught  to  reject  noise  as 
received  by  the  hydrophone  array.  The  specific  result  of  the 
teaching  process  is  a set  of  weighting  factors.  These  weights 
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are  applied  to  the  hydrophone  outputs  (either  in  raw  or  time 
delayed  form)  in  a multiply  and  add  operation  for  the  purpose 
of  providing  a single  array  output  which  has  the  desired 
characteristics.  As  expressed  by  Goode  (121),  "With  proper 
switching  between  the  two  modes-,  the  signal  power  is  maintained 
near  a constant  level,  and  the  noise  power  is  reduced  to  the 
minimum  possible  for  the  prescribed  level  of  signal  power."  It 
should  be  pointed  out  that  an  attempt  is  made  to  hold  signal 
distortion  to  a minimum. 

The  information  required  for  implementation  of  the 
technique  is  considerably  less  than  is  required  for  implementa- 
tion of  either  the  Wiener,  Bryn,  or  Shor  techniques.  Specifically, 
no  cross-power  functions  are  required  and  hence  the  need  for 
long  data  history  storage  is  eliminated.  What  is  required  for 
each  iteration  is  a measurement  of  the  instantaneous  values  of 
the  multichannel  input  (signal  or  noise)  and  the  values  of  the 
weights  calculated  in  the  previous  iteration.  The  history  data 
are  effectively  contained  in  the  values  of  the  weights  themselves. 

Widrow  and  Goode  are  also  engaged  in  research  related 
to  an  iterative  processor  which  simultaneously  adapts  on  signal 
and  noise,  thus  eliminating  the  need  for  two-mode  operation. 

This  is  analogous  to  the  Wiener  signal  extraction  technique  in 
that  the  system  minimizes  the  square  of  the  difference  between  a 
simulated  signal  and  the  output  of  the  processor  (Ref.  10,  June 
1966).  Goode  mentions  that  "An  analytical  and  computational 
study  will  be  necessary  to  arrive  at  an  accurate  description  of 
the  operating  characteristics  of  such  a system.  However,  pre- 
liminary results  indicate  a smaller  misadjustment  is  attained 
using  the  simultaneous  adaptation  algorithm,  than  with  the 
previous  algorithm,  especially  when  there  is  a strong  signal  in 
the  beam." 
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4.0  MATHEMATICAL  FORMULATIONS 

This  section  contains  the  mathematical  formulation  of 
the  design  equations  for  each  of  the  adaptive  space  processing 
techniques  under  discussion.  The  reader  is  referred  to  the 
bibliography  for  derivations  of  the  equations  by  the  original 
authors . 

4.1  BRYN  TECHNIQUE 

Bryn  (12)  derives  the  design  equations  for  the  system 
shown  in  Fig.  4.1.  The  equations  describing  the  filters  are 
given  by 


o o i /o  j^P-sCn) 

Zi(n)  = [U?(n)  + V?(n)]1/2  e 


9 


where 


Ui(n) 


Z [rhl(n)  cosVh  * rh,k+i(n)  sintwnTh^  * 
h=l 


Vi(n) 


K 

Z [rh,k+l(n)  cos“nTh  ‘ rhl(n)  ’H'h1' 
h=l 


cp.(n)  = tan-1 
1 Ui(n) 

These  equations  are  formulated  in  the  frequency  domain.  The 
index  n is  a frequency  index.  The  indices  h and  i are  related 
to  the  columns  and  rows  of  correlation  matrices.  The  number  of 
hydrophones  is  given  by  K.  The  terms  rhj.(n)  ancl  rh  k+i(n)  are 
elements  in  the  matrix  which  is  the  reciprocal  of  a noise  cor- 
relation matrix  given  by 
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^11 (n)  q12^n^  * * * ^l,2k^n^ 

CQn]  = ^21 q22^n^  • • . ^2, 2k  ' 

0 0 0 0 0 0 0 0 0 

q2k,l(n)  q2k,2(n^  . . q2k,2k(n)|  . 

The  elements  in  the  noise  correlation  matrix  represent  effec- 
tively the  real  and  imaginary  parts  of  the  complex  noise  cross- 
power functions.  The  following  is  true: 

■Uh(n)  = <>hi(n)  = Vn,  k+h  (n)  - ’k+h,  k+i  <n)- 

aKd  ‘•i,k+h<n)  - Vrt,,i>>  - ■‘ik+i.h  <n)  - •‘•h.k+i (n)- 

In  other  words,  the  matrix  is  broken  up  into  four  regions  as 
illustrated  by  Fig.  4.2.  The  regions  defined  by  A,  B,  C,  D,  and 
included  diagonals  contain  elements  which  are  the  real  parts  of 
the  cross-power  functions.  Element  values  are  symmetrical  across 
the  diagonal  from  area  A to  area  B and  from  area  C to  area  D. 

The  region  defined  by  C and  D and  the  included  diagonal  is  simply 
a reproduction  of  the  region  defined  by  A and  B and  the  included 
diagonal.  As  an  illustration,  the  elements  designated  with  a 
lower  case  "a”  are  all  equal. 

The  regions  defined  by  E,  F,  G,  H,  and  included  diag- 
onals contain  elements  which  are  the  imaginary  parts  of  the  cross- 
power functions.  As  such,  the  element  values  are  negative  sym- 
metric across  the  region  diagonals.  As  an  illustration,  the 
elements  designated  with  a lower  case  "b"  are  equal  except  for 
sign  as  indicated. 
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FIG.4.2  - ILLUSTRATION  OF  THE  BRYN  MATRIX 
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Although  it  isn't  explicitly  indicated  by  Bryn,  the 
diagonal  elements  in  the  regions  containing  the  imaginary  part 
of  the  cross  power  must  be  zero.  This  is  because  these  diagonal 
elements  represent  the  imaginary  portion  of  autopower  functions 
which  must  be  zero.  This  is  implied  in  the  second  of  the  two 
equations  given  previously  which  cannot  be  satisfied  for  i=h. 

This  matrix  is  totally  symmetric  about  the  main  diag- 
onal and  represents  a method  of  forming  a complex  matrix  by 
separating  the  real  and  imaginary  parts.  In  other  words,  this 
is  the  matrix  which  would  be  obtained  if  a system  of  complex 
linear  simultaneous  equations  were  to  be  written  out  so  as  to 
separate  the  real  and  imaginary  parts,  and  then  put  into  matrix 
form.  If  the  matrix  were  to  be  written  instead  in  a form  con- 
taining complex  elements,  it  would  be  only  half  as  large,  with 
the  number  of  complex  elements  along  a side  equal  to  the  number 
of  hydrophones  in  the  array.  Further,  it  would  be  Hermetian. 

The  remaining  terms  of  interest  in  the  Bryn  filter 
design  equations  are  the  terms  given  by  CosCu^t^)  and  Sin(u)nT^)  . 
These  terms  represent  the  real  and  imaginary  parts,  respectively, 
of  the  cross  power  describing  a single  direction  plane  wave 
signal.  In  this  representation,  uin  is  the  frequency  of  interest 
and  is  the  time  delay  required  to  project  the  hydrophone  out- 
puts onto  a plane  at  the  rear  of  the  array  for  a plane  wave  signal 
from  a single  direction. 

Since  the  system  design  is  performed  at  a single  fre- 
quency, the  output  from  each  hydrophone  for  a signal  can  be  con- 
sidered as  a sinusoid.  The  phase  of  the  sinusoid  relative  to  an 
arbitrary  reference  is  equal  to  the  product  of  the  frequency  in 
radians /second  and  the  time  delay  in  seconds.  The  cross  power 
between  each  hydrophone  and  a hydrophone  at  the  reference  can 
then  be  written  as  (A+jB)  where  Va"2+B^  equal  unity, 
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A = Cos  u)nTh> 


and 

B = Sin  uun  t^. 

Having  obtained  the  physical  interpretation  of  the 
terms  in  the  Bryn  design  equations,  it  is  possible  to  write  the 
equations  in  another,  possibly  more  conventional  form,  as  shown 
by  the  complex  matrix  given  below.  It  can  be  shown  by  expansion 
that  this  matrix  equation  is  equivalent  to  the  Bryn  design  equa- 
tions . 


R1 l+j  X11 

LR21+jI2l 


R12+jI12 
R22+^ ^22 


'ui+jvri 
JJ2+jV2J 


'Cos  uu  T^-j  Sin  a) 

f 

_Cos  u)  t2~3  Sin  w t2-/ 


(Tnroughout  the  text,  brackets  [ ] are  used  to  denote  square 
matrices  and  braces  ( } are  used  to  denote  column  matrices.) 
This  formulation  illustrates  that  the  Bryn  design  equations  can 
be  written  in  the  form 


K 

Z Nih(£)  • Hh(f)  = 


h=l 


i = 


9 


1,K, 


where  N^(f)  is  the  cross  power  set  describing  noise, 

H^(f)  is  the  set  of  complex  filters  to  be  designed, 

S*r  is  the  signal  cross  power  between  each  hydrophone 
and  a reference  behind  the  array. 
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The  significance  of  this  formulation  of  the  Bryn 
design  equations  is  the  similarity  which  it  bears  to  the  Wiener 
formulation  to  be  presented  later. 

These  equations  can  be  written  in  matrix  form  as 

CHh(f))  = [Nih(f)]_1  Cs!r(f))  . 

t-.2  MERMOZ  TECHNIQUE 

Mermoz  (7)  provides  a frequency  domain  solution  for 
a spatial  processing  system  designed  to  maximize  the  signal-to- 
noise  ratio  in  the  output  of  an  array  of  hydrophones  as 

l Cjk(f)  * hk(f)  = Ke"i2^fto  Sj(f), 

where  Cj^(f)  are  frequency  domain  cross-correlation  coefficients 
for  the  noise  field, 

H^Cf)  are  the  complex  frequency  filters  required  to 
maximize  the  signal- to-noise  ratio, 

Sv(f)  are  the  complex  conjugates  of  the  Fourier  trans- 
forms of  the  actual  signal  outputs  from  each 
hydrophone , 

e ° is  a phase  shift  associated  with  an  arbitrary 

definition  of  zero  time, 

K is  a scaler  associated  with  the  signal  amplitude. 

Since  the  value  of  t is  rather  arbitrary,  the  equations 
can  be  rewritten  in  the  following  form  and  considered  to  be  properly 
defined  within  an  arbitrary  time  delay. 


hJ 
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E Cjk(f)  hk(f)  = K S*  (f), 

From  j =1  to  j =N. 

This  formulation  looks  very  similar  to  the  Bryn  formulation. 
There  is,  however,  one  significant  difference.  In  the  Mermoz 
formulation,  the  terms  in  the  right  hand  side  contain  the  abso- 
lute phase  characteristics  of  the  signals  in  addition  to  the 
relative  phase  characteristics  between  signals  at  the  output  of 
the  various  transducers.  Hence,  the  Mermoz  formulation  will 
effectively  provide  a set  of  filters  which,  in  addition  to 
separating  signals  from  noise  on  a spatial  basis,  will  also 
maximize  the  signal-to-noise  ratio  by  providing  "matched"  filter- 
ing. 

4.3  SHOR  TECHNIQUE 

The  Shor  processor  is  shown  in  Fig.  4.3.  The  arrange- 
ment of  the  system  provides  for  a complex  weighting  factor  to  be 
applied  to  each  hydrophone  output.  The  imaginary  part  of  the 
complex  weighting  factor  is  obtained  by  phase  shifting  the  hydro- 
phone outputs  by  -90°  and  then  applying  a weighting  factor  bm  to 
the  phase  shifted  output. 

The  Shor  technique  is  an  iterative  process  whereby  the 
signal-to-noise  ratio  in  the  space  processor  output  is  maximized 
by  proper  selection  of  the  a and  b . The  space  processor  is 
followed  by  a conventional  matched  filter. 

The  values  of  the  a and  the  b„  are  determined  by  an 

mm  J 

iterative  process  which  simultaneously  minimizes  a set  of  error 
functions,  two  for  each  input  channel.  The  error  functions  are 
define.-  as 


G • = 
ai 


SiSo 


¥o 
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FIG.  4.3-  SHOR  ADAPTIVE  SPACE  PROCESSOR  (FROM  SHOR, 
J.  ACOUST.  SOC.  AMER,  JAN.,  1966) 
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and 


Si(-T)So  N^-TjiN^ 
°bi  = ’ 


S S 
o o 


NN 
o o 


where  S^SQ  is  the  cross  correlation  at  a single  frequency  between 
the  output  signal  and  the  input  signal  on  channel  i, 

(-T)Sq  is  the  cross  correlation  of  a single  frequency 
between  the  output  signal  and  the  time  delayed  input 
signal  on  channel  i, 

SQSo  is  the  average  power  at  a single  frequency  for  signal 
in  the  output, 

nTn^  is  the  cross  correlation  at  a single  frequency  between 
the  output  noise  and  the  input  noise  on  channel  i, 

Ni(-T)N0  is  the  cross  correlation  at  a single  frequency 
between  the  output  noise  and  the  time  delayed  input 
noise  on  channel  i, 

NqNo  is  the  average  noise  power  at  a single  frequency  in 
the  output. 

These  error  functions  are  minimized  by  iteratively 

evaluating 


a <l+l)  = a1  + 
ai  ai  + 


\ G 


ai 


(l) 


> 


and 


b.a+D  = b£  + X Gb.(4), 


where  a 


(•l+l) 


and  bi 


(-t+1) 


are  the  new  values  of  the  weighting 
coefficients , 
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a'1  and  are  Che  values  of  the  weighting  coefficients 
11 

from  the  previous  iteration, 

X is  a small  positive  real  constant, 

G ^ and  G are  the  measured  errors  for  the 
a i d l 

previous  iteration. 

This  technique  could  be  considered  for  broadband 
operation  by  replacing  each  of  the  phase  shift  networks  and  the 
a...  and  b weighting  factors  by  complex  frequency  filters.  There- 
fore,  even  though  the  system  is  described  for  a narrow  band  case, 
rha  concept  is  not  limited  to  narrow  band  operation.  For  wide 
band  operation,  it  would  be  necessary  to  measure  correlation 
coefficients  at  many  frequencies. 


WIENER  FREQUENCY  DONA IN  TECHNIQUE 


Burg  (L7)  gives  the  frequency  domain  design  equations 
for  the  Wiener  technique  as 


/,  ^Smj<f>  + Vf)l  HJ<f>  = Smo<f>> 
j=l 

m = 1 to  N, 


where  S . (f)  are  the  cross  power  functions  describing  signal, 
mj 

N .. (f ) are  the  cross  power  functions  describing  noise, 

nij 

Kj(f)  are  the  complex  frequency  filters  to  be  designed, 

S (f)  are  the  cross  power  functions  relating  the  signal 
mo' 

on  each  channel  to  the  signal  on  a reference  channe-. 

The  similarity  between  this  formulation  and  the  Bryn 
formulation  should  be  noted. 
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When  written  in  matrix  form,  the  Wiener  equations 

become 

(HJ  (£))  = [Smj(£)  (Smo(£))  . 

In  the  Wiener  formulation,  the  matrix  to  be  inverted  contains 
the  full  cross  power  set  which  describes  the  signal.  However, 
in  the  Bryn  formulation,  only  the  cross  power  functions  de- 
scribing noise  are  contained  in  the  matrix  to  be  inverted. 

4.5  WIENER  TIME  DOMAIN  TECHNIQUE 

The  Wiener  problem  can  be  formulated  in  the  time 
domain  as  well  as  in  the  frequency  domain.  However,  it  has  been 
indicated  by  Texas  Instruments  (104)  that  the  frequency  domain 
design  is  considerably  faster  (computationally)  than  the  time 
domain  design.  Consequently,  the  time  domain  formulation  is  not 
considered  in  detail  in  this  paper. 

4.6  WIDROW- GOODE  TECHNIQUE 

The  Widrow-Goode  technique  has  been  developed  so  as 
to  be  applicable  to  both  narrow-band  and  wide-band  systems.  The 
implementation  concept  for  narrow-band  systems  is  shown  in  Fig. 
4.4  and  that  for  wide-band  systems  is  shown  in  Fig.  4.5. 

Consider  first  the  narrow-band  implementation  shown 
in  Fig.  4.4.  The  system  is  shown  switched  into  mode  II,  where 
the  hydrophone  outputs  are  applied  to  the  processor  inputs  as 
shown.  In  this  mode,  it  is  desired  that  the  system  output  power 
be  zero.  Therefore,  any  output  is  considered  to  be  an  error. 
This  error  is  multiplied  by  each  hydrophone  output  and  each  time' 
delayed  hydrophone  output.  The  product  so  obtained  is  used  to 
modify  the  weighting  factors,  w.-  , in  a manner  to  be  described  in 
the  following  paragraphs.  While  operating  in  this  mode,  the 
system  is  "taught"  to  reject  noise. 


A 


23 


* 


ADAPTATION 

MACHINERY 


FIG.  4.4 -ADAPTIVE  PHASE  COMPENSATOR  (FROM  WIDROW,"PROPOSAL 
FOR  RESEARCH  ON  ADAPTIVE  HYDROPHONE  ARRAYS") 
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For  the  other  learning  mode,  the  outputs  of  a device 
containing  properly  phased  recordings  of  a narrow-band  signal  are 
applied  to  the  processor  inputs.  During  this  mode,  it  is  desired 
than  the  processor  output  reproduce  the  signal  as  it  would  appear 
on  one  of  the  hydrophone  outputs.  The  difference  between  the 
actual  output  and  the  desired  output  is  the  error  signal.  This 
error  signal  is  used  to  modify  the  weights.  During  this  mode, 
the  system  is  "taught"  to  faithfully  reproduce  signals.  Hope- 
fully, the  ability  to  reject  noise  is  not  forgotten. 

Finally,  the  system  can  be  switched  to  the  hydrophones 
and  listening  can  take  place. 

Now  consider  the  wide-band  implementation  shown  in 
Fig.  4.5.  This  implementation  is  similar  to  the  narrow-band 
implementation  with  one  major  exception.  A tapped,  weighted 
delay  line  is  provided  in  place  of  the  simple  weighting  mechanism 
shown  in  Fig.  4.4.  Each  of  the  weights  on  each  of  the  delay 
lines  is  adaptable.  Hence,  instead  of  being  provided  with  a 
simple  single  frequency  weighting  mechanism,  each  hydrophone  is 
provided  with  an  adaptable  frequency  filter.  (Weighted,  tapped 
delay  lines  constitute  a handy  method  of  building  frequency 
filters  with  programmable  impulse  responses.)  Therefore,  the 
array  can  be  made  to  perform  in  the  desired  fashion  over  a wide 
band  of  frequencies. 

4.6.1  Two-Mode  Implementation 

In  the  two-mode  implementation,  the  theory  of  operation 
is  the  same  whether  narrow-band  or  wide  operation  is  desired.  When 
the  system  is  switched  into  mode  i,  an  input  is  provided  which 
simulates  a signal  propagating  across  the  array  from  a particular 
airection.  While  the  system  is  operating  in  this  mode,  the  weights 
are  adjusted  so  that  the  system  output  is  the  best  estimate,  in 
f.-.e  least-mean-square-error  sense,  of  the  desired  output.  The 
cesired  output  is  a reproduction  of  the  signal  as  it  appears  at 
some  point  in  the  array.  In  mode  II,  actual  hydrophone  outputs 
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are  applied  to  the  system  and  the  weights  are  adjusted  toward 
zero  output. 

An  expression  can  be  readily  derived  for  the  mean- 
square-error  in  the  signal  estimation.  The  expression  for  the 
mean- square -err or  contains  cross  power  terms,  as  before.  Thus 
far,  little  has  been  said  that  is  different  from  those  techniques 
discussed  previously.  The  primary  difference  between  the  Widrow 
technique  and  previously  discussed  techniques  is  Widrow' s assump- 
tion that  the  instantaneous  square  error  is  a good  approximation 
to  the  mean-square-error.  Experimental  results  have  indicated 
-hat  the  assumption  appears  reasonable.  This  is  a particularly 
significant  approximation  since  it  eliminates  the  need  for  the 
long  data  history  storage  requirements  inherent  in  time-averaging 
type  processors. 

Widrow' s lea st-mean- square  (LMS)  adaptation  algorithm 
is  expressed  in  a continuous  form  as  (102) 

a|  = v «(t)  X(t). 

The  quantity  ft  represents  a vector  defined  by  the  weights,  y is 
a constant  which  controls  the  rate  of  adaptation,  £(t)  is  a vector 
time  function  representing  the  signals  as  applied  to  the  weights 
w . of  Fig.  4.5,  and  e(t)  is  a scalar  time  function  which  is  the 
difference  between  the  desired  instantaneous  response  d(t)  and 
the  actual  instantaneous  response  y(t): 

M K 

e(t)  = d(t)  - y(t)  = d(t)  - ^ 2 wij  xij^t^- 

1 1 

The  algorithm  is  derived  by  obtaining  che  gradient  of 
the  squared  error  as  follows: 
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[e(t)r  = Ld(t) 


M K 

V-'  'C~>  p 

Z,  ^ w!j  xij(t):i 

1 1 


The  change  in  the  squared  error  which  occurs  with  a change  in  an 
individual  weight  is  given  by 


a[e(t)]‘ 

dwij 


2[d(t) 


M K 

E E "ij  xij(t>> 

1 l 


which  by  substitution  gives 


— SUT—  “ - 2£(t)  xij(c)- 


Thus,  the  gradient  of  the  squared  error  is  seen  to  be  proportional 
to  the  product  of  the  instantaneous  error  and  the  signal  or  noise 
vector  xn.j(t).  By  the  method  of  steepest  descent,  the  change  in  w^ 
which  will  reduce  the  squared  error  the  fastest  is  a change  in 
the  direction  of  the  gradient.  Therefore,  the  iteration  algorithm 
may  be  written  as 


w 


ij 


U+D  _ ..  U)  ,ra[e(t)]2  (I)  _ 

i " wij  + - 2X  e(t)  X,..(t), 


IJ 


ij 


where  X is  a positive  real  constant  governing  the  rate  of  con- 
vergence and  the  stability. 

The  iterative  technique  requires,  therefore,  that  the 
hydrophone  (or  delay  line  tap)  outputs,  x^j (t)  and  the  error 
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between  the  desired  output  and  the  actual  output,  e(t),  be 
measured  at  a given  time.  The  weights  are  then  adjusted  by 
calculating  the  product 

2\  e ( t)  x-  (t)  . 

This  process  can  be  thought  of  as  searching  for  a 
multidimensional  vector  specified  by  the  set  of  weights  which  is 
as  near  as  possible  to  being  orthogonal  to  the  vectors  specified 
by  the  various  propagating  noise  components.  However,  a con- 
straint is  placed  on  ’the  weight  vector  such  that  the  product  of 
che  weight  vector  and  the  signal  vector  yields  some  desired  result. 
This  is  discussed  in  more  detail  in  Appendix  A. 

k.6.2  Simultaneous  Signal  and  Noise  Adaptation 

Widrow  and  Goode  are  also  doing  research  relative  to 
a system  which  does  not  require  two  adaptive  modes.  This  system 
simultaneously  adapts  on  both  signal  and  noise  to  minimize  the 
square  of  the  difference  between  a simulated  signal  and  the  actual 
processor  output.  As  of  this  writing,  a digital  technique  had 
been  formulated  and  reported.  However,  no  reports  were  available 
co  the  author  containing  experimental  results  obtained  with  the 
cechnique.  The  mathematical  formulation  of  the  technique  as 
reported  by  Goode  (Ref.  121,  June  1966)  is  quoted  below. 

"The  hydrophones  are  each  sampled  at  a rate  greater 
than  l/2fu,  where  fu  is  the  highest  frequency  passed  by  the 
hydrophone  filters.  (The  optimum  sampling  rate  is  yet  to  be 
determined.  The  number  of  bits  per  sample  is  also  an  interesting 
optimization  problem.)  The  samples  are  introduced  into  shift 
registers.  These  samples  will  be  denoted  by  x^(tj),  the  j 
sample  of  the  i“*'‘  hydrophone.  Another  set  of  shift  registers 
carry  the  simulated  signal  samples  s^(tj).  Each  shift  register 
is  tapped;  that  is,  several  parts  of  the  waveform  stored  in  the 
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shifc  register  can  be  used  simultaneously.  The  output  of  each 
cap  is  fed  to  a multiplier  where  it  is  multiplied  by  a 'weight', 
the  product  then  being  added  to  all  the  other  products  to  form 
a beam.  If  a hydrophone  contributes  to  more  than  one  beam,  each 
tap  is  fed  to  as  many  multipliers  as  there  are  beams  using  that 
hydrophone.  There  need  not  be  as  many  multipliers  as  there  are 
taps,  for  che  multipliers  may  be  multiplexed  and  operated  at  a 
faster  rate  than  the  shift  register  clock  rate.  For  every  beam, 
there  are  two  outputs  formed  using  the  same  set  of  weights.  One 
output,  denoted  by  X(t),  is  formed  from  the  data  actually  received 
by  the  hydrophones: 

K _L 

x(c>  = 2 a wy  xi(t  ‘ V’ 

i=i  j=l 

where  K = the  number  of  nydrophones  or  clusters  of  hydrophones 
used  to  form  a beam;  L = the  number  of  taps  on  each  shift  register, 
and  W..j  = weights.  Another  output  S(t),  distinct  from  X(t),  is 
formed  by  using  the  same  weights,  , and  the  simulated  signal 
from  the  direction  of  the  beam: 

K L 

S(t)  - 2 a wy  si(c  - V- 

i-i  j=i 

Thus,  reception  may  continue  without  interruption  during  adapta- 
tion. Ic  is  seen  that  the  system  must  be  digital  to  accomplish 
inis  objective. 

b^ 

''The  desired  output  is  taken  to  be  sc(t  - ~)  • The 
error  s(t)  is  defined  by 

b-r 

e(t)  = X(t)  + S(t)  - sQ(t  - *2=) . 
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5 . IMPORTANT  CHARACTERISTICS 

Even  though  the  techniques  under  discussion  appear 
capable  of  providing  the  same  output  signal- to-noise  ratio,  they 
differ  considerably  in  other  respects.  This  section  contains  a 
discussion  of  some  of  the  ways  in  which  they  differ. 

5.1  OUTPUT  SIGNAL  LEVEL 

Presumably,  any  adaptive  beamforming  technique  which  is 
put  into  operation  will  provide  output  signals  to  other  electronic 
equipment.  Consequently,  it  would  be  desirable  to  state  with 
assurance  that  a signal  producing  some  known  output  voltage  at 
the  transducer  would  produce  some  other  known  voltage  at  the  out- 
put of  the  adaptive  space  processor.  This  should  be  true  regard- 
less  of  the  present  state  of  the  spatial  organization  of  the 
background  noise  field.  This  is  one  major  area  of  difference 
between  the  adaptive  beamforming  techniques  under  discussion. 

An  important  characteristic  of  any  adaptive  beamforming 
technique,  therefore,  is  the  total  system  response  for  signals  on 
the  main  beam  axis.  The  Wiener  technique  and  the  Widrow  technique 
approximately  stabilize  the  signal  response  and  allow  the  noise 
response  to  vary  with  the  state  of  the  spatial  organization  of 
the  noise.  This  is  a result  of  optimizing  on  a criterion  which 
attempts  to  extract  the  signal  on  a noise-free,  distortion-free 
basis . 

On  the  other  hand,  with  the  Bryn  technique,  both  the 
signal  response  and  the  noise  response  depend  on  the  state  of 
the  spatial  organization  of  the  noise  field.  There  is  nothing 
in  the  design  equations  to  constrain  the  signal  response.  Hence, 
with  an  operational  adaptive  system,  it  could  be  exceedingly 
cifficult  to  predict  with  assurance  the  output  voltage  level  to 
expect  for  a given  input  signal  level. 


32 


TRACOR,  INC. 


6500  TRACOR  LANE.  AUSTIN.  TEXAS  78721 


If  the  output  were  passed  through  an  AGC,  the  absolute 
value  of  the  output  signal  level  would  become  meaningless. 

However,  in  the  event  that  the  absolute  level  of  the  output 
signal  is  important,  a simple  case  has  been  worked  out  to  illus- 
trate the  manner  in  which  the  Wiener  and  Bryn  techniques  differ 
in  this  respect.  The  results  are  given  in  Appendix  B. 

As  is  always  the  case,  the  Wiener  technique  does  not 
provide  the  advantage  of  a stablized  signal  output  free  of  charge. 
The  stabilization  is  purchased  at  the  expense  of  providing  a full 
signal  correlation  matrix,  which  is  not  needed  with  the  Bryn 
technique. 

Although  the  Shor  technique  does  not  necessarily 
provide  a stabilized  signal  response,  the  iterative  procedure 
could  be  modified  to  provide  such  stabilization  because, 
although  the  answers  from  the  Shor  technique  are  optimum,  they 
are  not  unique. 

5.2  COMPUTATIONAL  REQUIREMENTS 

There  are  important  differences  in  the  computational 
requirements  for  the  different  techniques.  A technique  which 
appears  to  be  computationally  most  attractive  for  one  problem 
will  not  necessarily  be  most  attractive  for  another. 

The  spatial  processing  portion  of  all  the  techniques 
can  be  illustrated  as  shown  in  Fig.  5.1. 

HYDROPHONES  COMPLEX  FREQUENCY 

FILTERS 


FIG.5I-  ILLUSTRATION  OF  SPATIAL  PROCESSORS 
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No  matter  which  design  technique  is  employed,  if  wide 
frequency  band  operation  is  desired,  the  spatial  processor  takes 
the  form  of  an  array  of  N hydrophones  each  feeding  a complex 
frequency  filter,  with  the  outputs  from  the  filters  summed.  A 
matched  filter  would  follow  the  summing  junction  with  the  Shor 
system  and  a frequency  weighted  square  and  integrate  device 
would  follow  the  summing  junction  with  the  Bryn  system.  Any 
conventional  temporal  processing  device  could  follow  the  summing 
junction  with  the  Wiener  or  the  Widrcw  systems. 

In  general,  the  frequency  filters  will  be  complex  with 
very  complicated  response  characteristics.  Further,  the  response 
characteristics  must  be  programmable  as  a function  of  time.  The 
only  method  known  to  the  author  of  obtaining  programmable, 
complicated,  complex  frequency  filters  is  through  the  use  of 
shaped  impulse  response  functions.  Although  this  can  be  done 
using  weighted,  tapped  analog  delay  lines,  the  need  for  rapid 
changes  in  the  program  makes  the  use  of  programmable  digital 
convolution  devices  more  attractive. 

The  problem,  then,  is  reduced  to  one  of  obtaining  a 
set  of  digital  convolution  operators,  or  sampled  impulse  response 
functions,  which  have  frequency  response  characteristics  as 
desired.  All  the  techniques  can  be  implemented  by  evaluating 
the  design  equations  at  many  closely  spaced  frequencies  and  then 
sorting  out  the  answers  thus  obtained  to  provide  the  optimum 
complex  frequency  filters  at  a set  of  sample  points  in  frequency. 
Using  these  optimum  frequency  filters,  the  sampled  impulse 
response  functions  can  be  obtained  by  performing  an  inverse 
Fourier  transform. on  each  of  the  complex  frequency  filter  functions. 
In  addition,  the  Widrow  wide-band  system  can  be  implemented  by 
adapting  the  individual  weights  in  the  digital  convolution 
operators . 

This  leads  to  a difficulty  as  pointed  out  by  Goode  (43) . 

In  general,  the  impulse  response  functions  will  be  non-negative 
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for  negative  time.  This  can  be  partially  compensated  for  by 
introducing  a finite  tittle  delay  into  the  processor  and  shifting 
the  negative  time  portion  of  the  response  into  positive  time. 

The  effectiveness  of  the  compensation  will  depend  on  how  rapidly 
the  impulse  response  converges  to  zero  for  negative  time.  In 
any  event,  this  problem  serves  to  illustrate  a larger  overall 
problem.  That  problem  is,  all  of  the  techniques  under  discussion 
can  be  used  to  solve  for  the  optimum  frequency  filters  to  be 
applied  to  the  transducers  to  effect  the  desired  result.  However, 
once  having  obtained  the  required  frequency  filtering  character- 
istics, these  filters  must  be  approximately  implemented  through 
the  use  of  finite  length  truncated  impulse  response  functions. 

The  degree  of  system  degradation  which  results  from  this  trunca- 
tion is  dependent  upon  the  complexity  of  the  noise  and  signal 
fields,  the  required  bandwidth,  etc. 

One  major  difference  between  the  Wiener  technique  and 
the  others  is  that  a method  of  performing  the  design  computations 
totally  in  the  time  domain  can  be  easily  derived  for  the  Wiener 
technique.  To  the  knowledge  of  the  author,  no  such  derivation 
has  been  performed  for  the  Shor  or  Bryn  techniques.  This  is 
quite  important.  The  result  of  the  time-domain  Wiener  design 
is  a set  of  optimum  impulse  response  functions  of  a given  length. 

In  general,  these  functions  will  be  different  from  those  resulting 
from  a frequency  domain  design  unless  the  functions  are  quite 
long.  Further,  for  short  functions,  the  Wiener  time  domain 
solution  will  provide  better  results  than  the  Wiener  frequency 
domain  solution.  Since  it  has  been  indicated  that  the  Wiener 
frequency  domain  technique  is  equivalent  to  the  other  techniques, 
it  is  tempting  to  conclude  that  the  Wiener  time  domain  solution 
will  provide  generally  better  results  than  the  other  two  techniques. 

There  is  a second  factor  which  makes  the  Wiener  time 
domain  solution  conceptually  more  attractive  than  the  Bryn 
frequency  domain  solution.  This  factor  has  to  do  with  the 
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difficulty  encountered  in  obtaining  good  estimates  of  the  cross 
power  density  spectra.  This  is  a subject  which  is  well  covered 
in  the  literature  and  will  not  be  further  discussed  here.  Let 
it  suffice  to  say  that  if  all  computations  are  performed  in  the 
time  domain  and  the  necessity  for  transforming  into  the  frequency 
domain  is  eliminated,  then  one  of  the  more  troublesome  aspects 
of  the  adaptive  system  design  problem  will  have  been  circumvented. 

Obviously,  as  is  always  the  case,  there  are  complications 
which  tend  to  reduce  the  attractiveness  of  the  Wiener  time  domain 
solution.  In  particular,  the  complications  have  to  do  with  the 
size  of  the  matrix  which  must  be  inverted.  For  the  Bryn  technique, 
the  solution  requires  inverting  a great  many  complex  square 
matrices  with  the  number  of  complex  elements  on  a side  equal  to 
the  number  of  channels  being  processed.  A channel  can  represent 
either  a single  transducer  output  or  a preprocessed  subarray  of 
transducers.  However,  with  the  Wiener  time  domain  solution,  the 
size  of  the  real  matrix  to  be  inverted  is  equal  to  the  product  of 
the  number  of  channels  and  the  number  of  filter  points  in  each 
sample  point  operator.  This  matrix  is  a Toeplitz  matrix  of 
submatrices  for  which  a solution  (123)  is  available. 

Unfortunately,  even  though  the  time-domain  matrix  is 
Toeplitz,  a time-domain  filter  design  is  still  considerably 
slower  than  a comparable  frequency-domain  design.  Texas 
Instruments  (104)  indicates  that  for  comparable  10-channel  design 
problems,  the  time-domain  design  requires  333,000  real  multiply 
and  add  operations  whereas  the  frequency  domain  design  requires  • 
only  21,000  complex  multiply  and  add  operations.  For  this 
example,  longer  impulse  response  functions  were  designed  with  the 
frequency  domain  approach  than  with  the  time-domain  approach 
to  provide  two  systems  which  were  of  equal  effectiveness.  From 
this,  it  seems  reasonable  to  conclude  that,  except  in  rare 
circumstances,  the  frequency-domain  approach  would  be  more 
practical  to  implement  than  the  Wiener  time-domain  approach. 
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It  seems  reasonable  to  expect  that  some  of  the 
advantages  inherent  in  the  Wiener  time-domain  solution  are  also 
possessed  by  the  Widrow  wide-band  technique.  That  is,  the  Widrow 
wide-band  technique  optimizes  on  the  basis  of  a finite  number 
of  weights  which  constitute  the  elements  of  a set  of  finite 
length  impulse  response  functions.  Further,  these  advantages 
are  obtained  without  the  necessity  of  either  storing  or  inverting 
the  large  matrix  required  for  the  Wiener  time-domain  solution. 

As  an  example,  if  it  were  desired  to  design  sample 
point  operators  41  points  in  length  for  50  channels  using  the 
Wiener  technique,  it  would  be  necessary  to  somehow  store  102,500 
correlation  values.  Subsequently  it  would  be  necessary  to  use 
these  102,500  correlation  values  to  invert  a Toeplitz  matrix 
which  is  2050  x 2050  in  size. 

For  a comparable  Widrow  problem,  it  would  be  necessary 
to  store  2050  weights,  possibly  2050  hydrophone  output  values, 
and  possibly  2050  signal  simulator  values,  a maximum  storage 
requirement  of  less  than  7000  words.  The  large  matrix  inversion 
would  be  replaced  by  an  iterative  multiply  and  add  process. 

Having  disposed  of  the  necessity  to  further  consider 
the  Wiener  time-domain  design  approach,  the  several  frequency 
domain  design  techniques  will  be  discussed  relative  to  their 
attractiveness  for  certain  classes  of  problems. 

Two  computational  operations  and  their  inherent  data 
storage  requirements  are  considered  to  be  most  important 
relative  to  the  implementation  of  adaptive  space  processing: 

(1)  Measurement  of  correlation  functions  or  frequency 
domain  cross-power  functions. 

(2)  Solution  of  system  equations  for  design  of  system 
parameters . 
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The  Bryn  technique  requires  the  solution  of  the 
following  matrix  equation  at  each  frequency  of  interest: 


Hh<f>  = ^(f)]-1  S*r(f) 


where  H^(f)  *-s  set  complex  frequency  filters  to  be 
applied  to  each  channel, 

N^|l(f)  is  the  normalized  cross-power  matrix  describing 
no  is  e , 

ifc 

S^r(f)  is  the  conjugate  of  the  normalized  cross-power 
column  vector  describing  signal. 

The  Wiener  frequency  domain  technique  requires  the 
solution  of  the  following  matrix  equation  at  each  frequency  of 
interest: 


H*(f)[  = rs..(f)  + Ni:j(f  >r1 


where  (f)  is  the  cross-power  matrix  describing  signal  and 

the  other  terms  are  essentially  the  same  as  in  the 
Bryn  formulation. 


There  are  three  classes  of  problems  which  deserve 
special  attention  relative  to  computational  requirements.  The 
approach  in  this  paper  is  to  consider  first  the  matrix  inversion 
techniques  in  an  attempt  to  determine  which  is  most  attractive 
for  a particular  problem  and  then  to  compare  the  technique  thus 
selected  with  the  iterative  techniques  as  applied  to  that  same 
problem. 

The  first  problem  that  will  be  considered  is  the  use 
of  a small  array  (less  than  50  transducers),  with  no  directional 
transducer  clustering,  for  the  purpose  of  detecting  a signal  of 
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unknown  waveform  from  space  organized  noise.  It  will  be  assumed 
that  continuous  monitoring  of  up  to  25  directional  beams  is 
required . 

The  second  problem  that  will  be  considered  is  identical 
to  the  above  problem  except  that  the  50  transducers  are  arranged 
in  subarray  clusters  ahd  the  clusters  are  pre-processed  in  a 
directional  fashion. 

The  third  problem  that  will  be  considered  is  identical 
to  the  second  problem  except  that  the  number  of  transducers  is 
increased  to  perhaps  1300. 

5.2.1  Small  Array  Problem  With  No  Clusters 

For  this  problem,  there  is  a significant  computational 
difference  between  the  Wiener  frequency  domain  technique  and  the 
Bryn  technique.  Recall  that  in  the  matrix  formulation  of  the 
Wiener  design  equations,  the  signal  cross-power  functions  are 
made  a part  of  the  matrix  which  must  be  inverted.  This  is  the 
characteristic  which  provides  the  signal  stabilization  discussed 
previously.  Consequently,  since  the  signal  matrix  describing 
each  different  signal  direction  is  different  from  the  matrix 
describing  every  other  signal  direction,  a different  signal  plus 
noise  matrix  would  have  to  be  inverted  for  each  desired  directional 
beam. 

Now  recall  that  for  the  Bryn  technique,  the  signal 
cross-power  functions  are  not  contained  in  the  matrix  to  be 
inverted.  The  directionality  of  the  signal  is  specified  simply 
by  a column  vector  that  is  used  to  multiply  the  inverse  of  the 
noise  matrix.  Consequently,  once  that  inverse  is  obtained,  the 
filter  weights  for  many  different  directional  beams  can  be 
obtained  simply  by  multiplication  of  the  inverse  matrix  by  many 
different  signal  column  vectors.  Hence,  only  one  matrix  inversion 
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is  required  for  the  design  of  many  directional  beams.  It  seems 
reasonable  to  conclude  then,  that  for  this  problem,  the  Bryn 
technique  is  computationally  more  attractive  than  the  Wiener 
technique . 

If  the  Bryn  technique  is  used,  some  method  of  stabilizing 
the  signal  response  will  probably  be  required.  There  is  a feed- 
back technique  which  could  be  utilized.  First  the  filter  weights 
for  one  beam  could  be  computed  in  the  normal  manner  at  each  fre- 
quency. Next  the  filter  weights  could  be  applied  to  a synthetic 
signal  at  each  frequency.  This  would  require  N complex  multipli- 
cations at  each  frequency.  Finally  a normalization  factor  could 
be  computed  at  each  frequency  which,  when  applied  to  all  the 
filter  weights,  would  provide  unity  signal  power  in  the  processed 
output. 

Finally,  it  is  instructive  to  evaluate  the  iterative 
techniques  as  they  apply  to  small  arrays  with  no  directionally 
sensitive  transducer  clustering.  It  will  be  assumed  that  a 50- 
channel  problem  can  be  handled  by  inversion  of  50  x 50  complex 
matrices . 

If  the  Bryn  technique  is  used,  at  each  frequency  it 
will  be  necessary  to  measure  1275  complex  noise  cross-power 
functions.  The  remainder  of  the  2500  cross-power  functions  in 
the  50  x 50  matrix  are  obtained  as  complex  conjugates.  In  other 
words,  the  matrix  will  be  Hermetian  and  all  elements  below  the 
diagonal  will  be  the  complex  conjugates  of  elements  above  the 
diagonal. 

Once  the  inverse  of  this  50  x 50  matrix  is  obtained, 
the  filter  weights  for  each  of  25  directional  beams  can  be 
obtained  simply  by  multiplication  of  the  inverse  matrix  by  25 
different  column  vectors. 

Now  consider  the  Shor  iterative  technique  as  applied  to 
the  same  small  array  problem.  In  the  Shor  technique,  the  design 
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of  the  filter  weights  for  each  beam  must  be  carried  out  separately. 
Considering  only  one  beam  at  a single  frequency,  each  iteration 
would  require  the  measurement  of  50  complex  noise  cross-power 
functions  and  50  complex  signal  cross-power  functions  or  a total 
of  100  complex  cross-power  measurements  per  beam  per  iteration. 

For  25  beams,  2500  cross-power  measurements  would  be  required  for 
each  iteration.  It  is  seen  then  that  for  this  problem  the  Bryn 
technique  would  require  the  measurement  of  substantially  fewer 
cross-power  functions  than  the  Shor  iterative  technique. 

It  is  concluded  that  for  the  problem  of  a small  array 
utilizing  no  directionally  sensitive  transducer  clustering,  pro- 
cessed to  provide  a large  number  of  directional  beam  outputs,  the 
Bryn  matrix  inversion  technique  is  computationally  more  attractive 
than  either  the  Wiener  matrix  inversion  technique  or  the  Shor 
iterative  technique.  As  the  number  of  output  beams  decreases, 
the  relative  attractiveness  of  the  Bryn  technique  decreases  also. 

Now  consider  the  use  of  the  Widrow  iterative  technique 
for  this  problem.  The  storage  requirements  for  a single  frequency 
solution  consist  of  2500  weights,  possibly  50  hydrophone  output 
values  and  possibly  1250  signal  simulator  output  values,  a total 
of  less  than  4000  storage  locations.  In  comparison,  the  Bryn 
technique  would  require  storage  of  2500  complex  cross-power  values 
or  about  5000  words  for  the  noise  matrix  alone.  In  addition  to 
storage  of  the  noise  matrix,  the  Bryn  technique  would  require 
storage  of  the  history  data  from  which  the  cross-power  values 
are  obtained.  This  would  constitute  possibly  another  5000  to 
10,000  locations.  Finally,  the  Bryn  technique  would  require 
storage  of  the  same  2500  weights  (1250  complex  weights)  as  in  the 
Widrow  technique,  for  a total  of  possibly  17,500  storage  locations. 

Unquestionably,  the  Widrow  technique  has  an  advantage 
over  the  Bryn  technique  in  terms  of  required  storage.  Any 
statement  related  to  computational  difficulty  would  be  premature 
at  this  time  since  the  convergence  rates  for  the  Widrow  technique 
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when  utilized  against  real  sea  data  are  unknown.  There  are, 
however,  indications  that  the  Widrow  technique  will  prove  to  be 
computationally  advantageous  relative  to  the  Bryn  matrix 
inversion  technique,  particularly  with  regard  to  wide-band  operation. 

Consideration  was  not  given  to  the  Mermoz  matrix 
inversion  technique.  This  is  because  the  Mermoz  technique  requires 
that  the  exact  waveform  of  the  signal  be  known. 

5.2.2  Small  Array  Problem  - Directionally  Sensitive  Cluster 

Pre-processing 

The  next  problem  to  be  considered  is  that  of  a small 
array  of  50  transducers  processed  to  provide  25  directional  beam 
outputs  wherein  five  directionally  sensitive  clusters  of  trans- 
ducers are  formed. 

For  example,  assume  the  50  transducers  are  combined 
into  five  subarrays  of  10  elements  each.  Assume  each  of  the  10 
small  subarrays  is  processed  through  conventional  beamforming 
techniques  to  provide  five  low- resolution  beam  outputs.  This 
situation  is  pictured  in  Fig.  5.2. 

The  adaptive  space  processing  problem  can  then  be 
considered  as  five  separate  processors  wherein  each  processor  has 
five  inputs.  Each  adaptive  space  processor  will  provide  five 
high  resolution  adaptive  directional  outputs  where  the  directions 
are  contained  within  the  low  resolution  directional  beam  of  the 
conventional  beamformers  used  as  input. 

The  same  considerations  apply  to  each  of  these  parallel 
space  processors  as  applied  to  the  single  space  processor  discussed 
in  the  previous  section.  Once  again,  the  Bryn  matrix  inversion 
technique  is  computationally  more  attractive  than  the  Wiener 
technique;  one  matrix  inversion  can  be  used  to  provide  the 
complex  weighting  factors  for  five  adaptive  beams  with  the  Bryn 
technique,  and  five  matrix  inversions  are  required  to  do  the  com- 
parable job  with  the  Wiener  technique. 
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The  Bryn  technique  will  continue  to  remain  more 
attractive  so  long  as  a single  inverse  noise  matrix  can  be  used 
to  generate  multiple  beams.  If  the  noise  input  were  such  that  a 
new  noise  cross-power  matrix  would  be  required  for  the  design 
of  each  new  beam  using  the  Bryn  technique,  then  the  Wiener  tech- 
nique would  become  more  attractive  by  virtue  of  the  signal 
stabilization.  However,  it  is  difficult  to  envision  a situation 
where  the  Bryn  technique  could  not  be  used  to  design  at  least  two 
beams  from  a single  noise  matrix  obtained  by  pre-processing  of 
smaller  subarrays. 

Now  the  question  remains  as  to  what  advantage  might  be 
realized  through  use  of  an  iterative  technique  for  this  problem. 
Since  the  matrices  to  be  inverted  are  quite  small  it  is  difficult 
to  see  how  any  advantages  would  be  realized  by  the  Shor  technique. 
For  each  adaptive  processor,  it  would  be  necessary  to  measure 
10  complex  cross-power  functions  per  output  beam  per  iteration. 
Five  output  beams  would  require  measurement  of  50  cross-power 
functions  for  a single  iteration.  However,  the  Bryn  design  for 
five  output  beams  could  be  completed  using  only  15  noise  cross- 
power functions  and  25  signal  cross-power  functions. 

It  is  concluded  that,  for  this  problem,  the  Bryn 
technique  is  computationally  more  attractive  than  either  the 
Wiener  matrix  inversion  technique  or  the  Shor  iterative  technique. 
Comments  which  were  made  in  the  previous  problem  relative  to  the 
Widrow  technique  apply  here  also. 

Obviously,  for  this  problem  it  may  be  desirable  to 
apply  wide-beam  adaptive  techniques  to  the  subarrays  for  pre- 
processing. In  general,  the  conclusions  drawn  above  would  be 
applicable  to  pre-processing  of  subarrays  as  well. 

5.2.3  Large  Array  Problem  - Directionally  Sensitive  Cluster 

Pre-processing 

The  last  problem  to  be  considered  is  that  of  a very 
large  array  containing  perhaps  1300  separate  transducers.  There 
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should  be  general  agrement  that  with  the  present  state  of  the  art, 
some  sort  of  subarray  cluster  processing  would  be  required  in 
order  to  implement  adaptive  space  processing. 

Assume  it  is  desired  to  provide  multiple  beam  outputs 
from  this  array.  The  problem  is  very  similar  to  the  problem 
discussed  in  the  previous  section.  Assume  once  again  that  it  is 
desired  to  provide  25  adaptive  beam  outputs,  and  that  each  of 
the  subarrays  is  processed  using  conventional  beamforming  to 
provide  25  beam  outputs.  In  other  words,  each  conventional  beam 
from  each  subarray  contributes  to  only  one  adaptive  beam  for  the 
entire  array.  Assume  the  1300  elements  are  grouped  into  subarrays 
containing  26  elements  each  for  a total  of  50  subarrays. 

This  problem  can  be  pictured  as  25  separate  adaptive 
space  processors  each  of  which  acts  upon  50  input  channels  to 
provide  a single  adaptive  beam  output. 

With  the  system  organized  in  this  fashion,  the  pre- 
viously discussed  advantages  of  the  Bryn  technique  over  the 
Wiener  technique  disappear.  No  matter  which  technique  is  used, 
a single  matrix  inversion  would  contribute  to  only  one  output 
beam.  Thus,  it  would  be  necessary  to  invert  a 50  x 50  complex 
matrix  at  each  frequency  for  each  output  beam.  Consequently, 
the  Wiener  technique  would  probably  be  most  appropriate  due  to 
the  inherent  signal  level  stability. 

A more  reasonable  means  of  operating  the  system  would 
be  to  have  each  subarray  provide  only  13  beams,  with  some  beam 
broadening  employed  if  necessary.  Then  only  13  separate  adaptive 
processors  would  be  required  and  one  noise  matrix  inversion  could 
be  used  to  design  two  adaptive  output  beams.  Under  this  condition, 
the  Bryn  technique  would  be  computationally  advantageous  over 
the  Wiener  technique. 

Since  this  is  a multiple  beam  problem,  the  Shor  iterative 
technique  probably  would  not  prove  advantageous.  For  the  first 
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case  above,  the  iterative  technique  would  require  the  measurement 
of  2500  complex  cross-power  functions  per  iteration  to  provide 
25  beam  coverage.  The  Bryn  technique  would  require  the  measure- 
ment of  31,875  complex  cross-power  functions. 

In  order  to  be  comparable  on  a cross -power  measurement 
basis,  the  Shor  iterative  technique  would  be  required  to  converge 
in  about  13  iterations.  It  is  doubtful  if  this  would  be  the 
case. 

Now  consider  another  problem  associated  with  the  large 
array.  Consider  providing,  in  addition  to  the  25  preformed 
adaptive  beams  mentioned  above,  two  adaptive  tracking  beams.  Let 
this  beam  be  formed  using  200  individual  elements  as  input  or 
200  sums  of  very  closely  spaced  elements.  Assume  that  a method 
for  generating  signal  cross-power  models  is  available  based  on 
position  and  speed  information. 

To  attempt  to  perform  this  operation  using  either  the 
Bryn  or  Wiener  techniques  would  require  inversion  of  a 200  x 200 
matrix  each  time  it  were  desired  to  update  the  beam.  Even  if 
this  were  feasible,  it  would  be  necessary  to  measure  20,100 
cross-power  functions  each  update  cycle.  If  a means  of  using 
the  Shor  iterative  technique  could  be  implemented,  only  400 
cross-power  measurements  per  iteration  would  be  required.  If 
the  technique  would  converge  in  less  than  50  iterations,  it 
may  prove  more  attractive  than  the  matrix  inversion  techniques. 

Although  some  very  complicated  problems  are  involved, 
the  example  illustrates  the  conditions  under  which  the  Shor 
iterative  technique  is  attractive.  The  technique  is  attractive 
whenever  a large  number  of  transducers  is  to  be  processed  for 
the  purpose  of  providing  a single  or  at  least  a very  few  output 
beams.  Obviously,  for  any  case  where  the  Shor  iterative  technique 
would  prove  attractive,  the  Widrow  technique  would  be  even  more 
attractive. 
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5.3  COMPUTATIONAL  STABILITY 

Another  characteristic  which  differs  between  the 
techniques  is  the  computational  stability.  Although  it  is 
difficult  to  say  anything  very  general  in  this  regard,  there  are 
a few  points  that  are  worthy  of  note. 

The  computational  procedure  in  both  the  Bryn  and  Shor 
techniques  will  probably  tend  to  become  unstable  as  the  percent 
random  noise  decreases.  This  is  because  for  no  random  noise, 
it  is  possible,  in  some  cases  at  least,  to  produce  an  infinite 
signal- to-noise  ratio  in  the  output,  and  infinity  is  not  mathe- 
matically palatable. 

The  result  of  having  no  random  noise  is  to  drive  the 
Shor  normalized  noise  correlation  indeterminate,  and  to  drive 
the  Bryn  matrix  singular. 

Even  though  the  Bryn  noise  matrix  is  singular,  the 
Wiener  signal  plus  noise  matrix  will  not  necessarily  be  singular. 
Therefore,  it  is  tempting  to  conclude  that  the  Wiener  computations 
will  be  generally  more  stable.  However,  there  is  a danger  to 
this  conclusion.  It  is  also  possible  to  have  a singular  Wiener 
matrix,  with  a nonsingular  Bryn  matrix.  It  is  believed,  however, 
that  such  a matrix  would  not  describe  a physically  obtainable 
situation . 

5.4  OTHER  CHARACTERISTICS 

There  are  other  characteristics  worthy  of  analysis 
which  still  require  study.  For  example,  among  the  questions  for 
which  answers  are  not  yet  available  are  the  following:  How  do 
the  techniques  compare  when  it  is  desired  to  control  the  main 
beam  width  to  some  fixed  value?  How  sensitive  are  the  systems 
to  equalization  problems  within  the  array  transducers? 
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APPENDIX  A 

COMPUTATIONAL  EXAMPLES  FOR  WIDROW-GOODE  TECHNIQUE 

In  order  to  develop  some  feeling  for  the  physical 
significance  of  the  Widrow-Goode  iterative  technique,  it  was 
instructive  to  apply  the  technique  to  a very  simple  problem  and 
observe  the  variations  of  certain  parameters  as  a function  of 
the  number  of  iterations. 

A particularly  simple  problem  was  chosen  for  which 
the  optimum  solution  could  be  obtained  by  inspection.  The 
problem  is  illustrated  in  Figure  A-l.  Three  omnidirectional 
hydrophones  were  assumed  to  be  arranged  equally  spaced  on  a line 
perpendicular  to  the  desired  "look"  direction,  or  axis,  for  signal. 
The  two  outer  hydrophones  were  assumed  to  be  averaged  together. 

A single  frequency  noise  source  was  assumed  to  lie  at  a bearing 
angle  of  60°  off  the  look  axis,  as  shown.  Hence  a noise  attenua- 
tion of  6 dB  was  obtained  in  the  output  at  the  two  element 
"cluster."  It  was  assumed  that  the  signal  was  also  single  fre- 
quency, and  that  ambient  and  circuit  noise  was  non-existent. 

With  this  configuration,  the  optimum  solution  was  obtained  when- 
ever Wl  was  equal  to  -1  and  W2  was  equal  to  +2.  This  set  of 
weights  provided  an  infinite  signal- to-noise  ratio  in  the  pro- 
cessor output.  Using  this  configuration  it  was  not  necessary  to 
provide  phase  shifts  other  than  zero  or  180  degrees.  Hence,  the 
time  delay  networks  could  be  omitted. 

It  was  assumed  that  the  iteration  rate  was  an  integral 
submultiple  of  the  signal  and  noise  frequency.  Hence,  each  time 
a measurement  was  made  of  the  single  frequency  signal  amplitude 
or  noise  amplitude,  the  same  value  was  obtained.  It  was  assumed 
that  measurements  were  made  at  times  corresponding  to  the  peaks 
of  the  signal  and  noise  sinusoids.  Signal  measurements  always 
yielded  unity  on  both  channels.  Noise  measurements  always  yielded 
unity  on  channel  No.  1 and  0.5  on  channel  No.  2. 
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The  signal  error  was  defined  to  be 
ES  = 1.0  - (Wl  + W2), 
and  the  noise  error  was  defined  to  be 

EN  = -(Wl  + 0.5  W2). 

The  output  signal  amplitude  was  defined  to  be 

SIGAMP  = Wl  + W2. 

The  output  signal  to  noise  ratio  was  defined  to  be 

SNRAT  = -SIGAMP/EN. 

During  mode  II,  the  weighting  functions  were  adjusted  according 
to 

Wl  = Wl  + 0.1  EN, 

W2  = W2  + 0.05  EN. 

Alternately,  during  mode  I,  the  weighting  factors  were  adjusted 
by 

Wl  = Wl  + 0.1  ES, 

W2  = W2  + 0.1  ES. 

It  was  assumed  that  Wl  and  W2  were  each  equal  to  0.5  at  the 
beginning  of  the  iterative  process. 

Experimental  results  are  shown  in  Figure  A-2.  For 
this  experiment,  the  time  spent  in  mode  I was  equal  to  the  time 
spent  in  mode  II.  Several  interesting  parameters  are  shown 
plotted  in  Figure  A-2  as  a function  of  the  number  of  iterations. 
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The  system  was  switched  alternately  between  the  two  modes.  One 
iteration  included  sequential  operation  in  both  modes.  For  each 
iteration,  the  results  at  the  end  of  mode  I and  at  the  end  of  mode 
II  are  shown  plotted.  The  values  of  the  parameter®  can  be  thought 
of  as  alternately  switching  back  and  forth  between  the  broken  and 
solid  lines  during  each  iteration. 

The  curves  are  particularly  well  behaved,  with  the 
values  of  W1  and  W2  asymptotically  approaching  the  optimum  values 
of  -1  and  2 respectively.  Of  particular  interest  to  the  author 
was  the  manner  in  which  the  value  of  the  output  noise  amplitude 
varied  as  the  system  was  switched  from  mode  I to  mode  II.  When- 
ever the  switch  was  made  and  the  system  was  taught  to  preserve 
signals,  the  noise  in  the  output  increased  by  1.15  dB.  Early  in 
the  iterative  process,  training  the  system  to  reject  noise  caused 
a comparable  change  in  the  signal  response.  Hence,  the  S/N  follow- 
ing mode  II  was  little  different  from  the  s/N  following  mode  I. 

By  the  time  150  iterations  had  been  completed,  training  the  system 
to  reject  noise  had  little  effect  on  the  signal  response  but  train- 
ing the  system  to  preserve  signals  consistently  reduced  the  noise 
rejection  by  1.15  dB.  Hence,  the  s/N  at  the  end  of  modes  I and 
II  began  to  spread. 

Another  interesting  aspect  of  the  curves  is  the  log- 
arithmic (or  dB)  linearity  of  the  output  noise  amplitude  follow- 
ing the  initial  fluctuations.  Logarithmic  linearity  of  the 
output  noise  with  a negative  slope  indicates  that  the  output 
noise  was  reduced  by  the  same  factor  each  iteration.  The  noise 
at  the  end  of  each  mode  II  was  consistently  99.2  percent  of  the 
noise  at  the  end  of  the  previous  mode  II. 

The  space  filtering  problem  can  be  considered  as  a 
problem  of  finding  a weight  vector  which  is  orthogonal  to  the 
noise  vector.  However,  the  weight  vector  must  be  such  that 
multiplication  by  the  signal  vector  will  yield  the  desired  result. 
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This  concept  is  illustrated  pictorially  in  Figure  A-3 
which  shows  the  signal  vector,  the  noise  vector,  the  optimum 
weight  vector,  and  the  locus  of  the  actual  weight  vector  obtained 
by  iteration.  An  axis  at  orthogonality  is  shown  by  one  of  the 
broken  lines.  Any  weight  vector  which  lies  on  this  axis  would 
be  orthogonal  to  the  noise  vector,  and  hence  would  satisfy  the 
noise  requirement. 

There  are  an  infinite  number  of  vectors  which  will 
satisfy  the  signal  constraint.  The  locus  of  these  vectors  is 
shown  by  a broken  line.  However,  there  is  only  one  vector  which 
will  satisfy  both  the  signal  constraint  and  the  noise  constraint 
simultaneously.  That  is  the  vector  defined  by  the  intersection 
of  the  axis  of  orthogonality  and  the  locus  of  all  vectors  which 
satisfy  the  signal  constraint. 

The  process  of  training  the  system  to  reject  noise 
can,  therefore,  be  thought  of  as  adjusting  the  direction  of  the 
weight  vector  toward  the  axis  of  orthogonality.  The  alternative 
process  of  training  the  system  to  preserve  signal  can  be  thought 
of  as  adjusting  the  weight  vector  so  as  to  provide  the  proper 
product  between  the  weight  vector  and  the  signal  vector. 

As  the  noise  vector  and  the  signal  vector  become  more 
nearly  equal,  the  length  of  the  weight  vector  would  be  required 
to  increase  in  order  to  preserve  signal.  This  is  because  the 
angle  between  the  signal  vector  and  the  axis  of  orthogonality 
would  approach  90°.  The  cosine  of  the  angle  would  decrease,  and 
hence  the  product 


SW  cos  0gw 

would  also  decrease  unless  W increased  proportionately.  This 
leads  to  the  "super  gain"  array  concept  encountered  in  radar 
applications  several  years  ago. 
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FIG.  A-3- LOCUS  OF  WEIGHT  VECTOR  IN  TWO-CHANNEL 
WIDROW-GOODE  EXPERIMENT  REF.  FIG.  A-2 
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Figures  A-4  and  A-5  show  the  results  of  a second 
experiment.  The  only  difference  between  this  experiment  pnd  the 
previous  experiment  was  the  percentage  of  time  spent  in  mode  I. 

In  the  previous  experiment,  the  iterative  process  alternately 
switched  between  mode  I and  mode  II.  For  the  second  experiment, 
ten  consecutive  iterations  were  performed  in  mode  II  followed  by 
a single  iteration  in  mode  I.  The  signal  and  noise  values  were 
not  changed. 

The  results  were  generally  as  would  be  predicted. 

Within  40  iterations,  the  weight  vector  was  very  close  to  the 
axis  of  orthogonality.  Hence,  the  noise  output  was  very  low. 
However,  the  output  signal  level  was  also  very  low  since  the 
weight  vector  was  not  capable  of  satisfying  the  signal  constraint. 
This  caused  the  signal  error  to  be  large  which  in  turn  caused 
considerable  spread  between  the  results  at  the  end  of  the  respec- 
tive modes. 

All  in  all,  the  iterative  process  was  somewhat  less 
efficient  than  the  iterative  process  in  the  previous  experiment. 
During  the  300  iterations  of  the  second  experiment,  the  weights 
were  adjusted  a total  of  330  times.  At  the  end  of  330  weight 
adjustments,  the  output  signal- to-noise  amplitude  ratio  was  6.05. 
In  the  previous  experiment,  33O  weight  adjustments  were  performed 
in  165  iterations.  At  the  end  of  165  iterations,  the  output 
signal-to-noise  ratio  was  7.5. 

The  remarks  in  the  previous  paragraph  were  based  on 
the  assumption  that  the  iterative  process  should  be  ended  in  a 
mode  I operation.  If,  on  the  other  hand,  signal  response  were 
not  a major  consideration  and  the  output  signal-to-noise  ratio 
were  of  prime  importance,  then  the  iterative  process  in  the  second 
experiment  would  be  most  efficient.  At  the  end  of  329  weight 
changes,  the  output  signal-to-noise  ratio  was  18.94.  In  the  pre- 
vious experiment,  255  total  iterations  or  510  weight  changes  were 
required  to  produce  an  output  signal-to-noise  ratio  this  large. 
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Those  familiar  with  the  Wiener  technique  will  recognize 
this  tradeoff  between  signal  preservation  and  signal- to-noise 
improvement  as  a common  occurrence  in  space  processing.  Quite 
often,  if  a spatial  processing  system  is  allowed  to  produce 
signal  distortion,  it  will  also  produce  more  processing  gain  than 
a similar  system  constrained  to  minimize  signal  distortion.  In 
fact,  techniques  such  as  the  Mermoz  technique  which  are  designed 
to  maximize  the  signal-to-noise  ratio  may  be  thought  of  as  pro- 
ducing signal  distortion  in  an  optimum  manner. 

Figures  A-6  and  A-7  show  the  results  of  a third  experi- 
ment. This  experiment  differed  from  the  previous  experiment  in 
one  respect.  For  the  third  experiment,  whenever  the  time  came  to 
adjust  the  weights  so  as  to  satisfy  the  signal  requirement,  the 
weight  vector  was  simply  lengthened  without  changing  its  direction. 
Hence,  the  signal  response  was  improved  with  no  degradation  in 
the  signal-to-noise  ratio. 

The  top  illustration  in  Figure  A-6  shows  the  manner  in 
which  the  weight  vector  was  changed  through  the  iterative  process 
of  experiment  number  2.  Ten  iterations  were  used  to  position  the 
weight  vector  toward  the  axis  of  orthogonality.  Following  this, 
one  iteration  was  used  to  position  the  weight  vector  toward  the 
locus  of  all  possible  vectors  which  would  properly  preserve  signal. 
It  can  be  seen  that  whenever  the  weight  vector  was  repositioned 
so  as  to  preserve  signal,  it  was  also  changed  in  direction.  Hence, 
a decrease  in  S/N  occurred  whenever  the  system  was  taught  to 
preserve  signals. 

The  bottom  illustration  in  Figure  A-6  shows  the  manner 
in  which  the  weight  vector  was  changed  through  the  iterative  pro- 
cess of  experiment  number  3»  The  additive  iteration  process  used 
to  adjust  the  weights  for  signal  preservation  in  experiment  number 
2 was  replaced  by  a multiplicative  adjustment  process  in  experiment 
number  3*  Hence,  the  operation 
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W1  = W1  + 0.1  ES 
W2  = W2  + 0.1  ES 

was  replaced  by 

W1  - Wl/SIGAMP 
W2  - W2/SIGAMP. 

No  change  was  made  in  the  iterative  process  relating  to  the 
suppression  of  noise. 

As  illustrated  in  Figure  A-6,  the  effect  of  this 
change  in  formulation  was  considerable.  Within  50  iterations, 
the  weight  vector  was  very  near  to  the  optimum  weight  vector. 

This  is  further  illustrated  in  Figure  A-7  which  shows  the  output 
S/N  plotted  versus  the  number  of  iterations.  A larger  processing 
gain  was  obtained  with  40  iterations  in  experiment  number  3 than 
was  obtained  with  300  iterations  in  experiment  number  2. 

Admittedly,  this  is  a very  simple  example.  However, 
it  may  be  possible  to  extrapolate  the  results  obtained  from  this 
simple  example  to  more  complicated  problems.  The  results  suggest 
the  conclusion  that  for  most  efficient  operation,  the  formulation 
of  the  iterative  technique  related  to  signal  preservation  may  be 
different  from  the  formulation  of  the  iterative  technique  for 
noise  suppression. 

In  any  event,  this  simple  example  does  serve  to  illus- 
trate the  nature  of  the  iterative  technique,  particularly  as  seen 
from  a vector  multiplication  viewpoint. 
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APPENDIX  B 

OUTPUT  SIGNAL  LEVEL  CONSIDERATIONS  FOR 
WIENER  AND  BRYN  PROCESSORS 

A very  simple  problem  was  worked  in  order  to  illustrate 
the  output  signal  level  characteristics  of  the  Wiener  and  Bryn 
processors . 

The  problem  is  as  illustrated  in  Fig.  B-l  below. 

Three  hydrophones  are  arranged  in  a line  array  with  a spacing 
of  l/2  wavelength.  The  two  outer  phones  are  averaged  to  provide 
channel  number  one  for  the  processor.  The  center  phone  provides 
channel  number  two  for  the  processor. 


PROCESSOR 


FIG.  B.l -ARRAY  PROBLEM  USED  TO  ILLUSTRATE  SYSTEM  SIGNAL 
RESPONSE 


B-l.  ARRAY  PROBLEM  USED  TO  ILLUSTRATE  SYSTEM  SIGNAL  RESPOXS 
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The  array  is  excited  by  signals  arriving  broa^  si^c 
zo  the  array  and  by  noise  arriving  with  some  angle  5 as  shown. 
With  the  two  outer  phones  added  in  this  manner,  all  cross-p;jw.-r 
f .u'.c cions  must  be  purely  real-  Hence,  A and  B can  be  real 
weighting  factors. 

Appropriate  calculations  were  made  so  that  the  output 
signal  level,  output  noise  level,  and  the  output  signal- to-noisc 
ratio  for  the  two  techniques  as  a function  of  the  angle  3 could 
be  compared. 

The  Wiener  design  matrix  is  given  by 

j S11  + N11  S12  + N12  i P i pll| 

1 { r < > 

PS21  + N21  S22  + N22_  l?2lj 

and  the  Bryn  design  matrix  is  given  by 


for  the  Bryn  technique,  the  noise  and  signal  correlations  are 
normalized,  apparently  by  the  auto  power  on  one  channel.  This 
point  is  not  too  clear.  It  appears  in  Bryn's  text  that  the 
assumption  is  made  that  the  average  noise  power  on  all  channels 
must  be  equal  and  the  average  signal  power  on  all  channels  must 
be  equal.  This  is  an  unduly  severe  restriction  which  would 
eliminate  the  technique  from  practical  consideration  at  the  out- 
set. Therefore,  Bryn's  normalized  correlation  has  been  interpreted 
to  be  normalized  simply  by  the  average  power  on  a single  channel. 

With  the  Wiener  technique,  no  such  assumption  is 
necessary.  However,  in  order  to  provide  a basis  for  comparison, 
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the  following  problem  was  worked  with  the  signal  and  the  noise 
correlation  matrices  normalized  on  channel  number  2. 

Four  cases  were  considered  with  9 equal  to  90°,  9.6°, 
4.15°  and  0°  respectively.  Pertinent  results  are  contained  in 
Table  number  I. 

The  effect  on  the  output  signal  power  level  of  varying 
3 is  clearly  illustrated.  As  0 varies  from  90°  to  0°,  the  output 
power  for  the  Bryn  technique  varies  from  40,000  to  1.  This  would 
require  a 46  dB  dynamic  range  for  the  equipment  operating  on  the 
output  signal.  The  output  signal  power  for  the  Wiener  technique 
varies  between  0.989  and  0.25,  a change  of  only  5.96  dB.  Further, 
che  output  signal  power  for  the  Wiener  processor  could  be  readily 
stabilized  to  within  3 dB  with  no  appreciable  change  in  the  space 
processing  gain.  No  straightforward  method  of  stabilizing  the 
output  signal  level  from  the  Bryn  processor  in  the  matrix  inver- 
sion is  apparent  at  this  time.  However,  a feedback  type  of 
stabilization  can  be  implemented. 
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